System and method for providing front-oriented visual information to vehicle driver

ABSTRACT

A camera system is installed on the front end of a vehicle, either on the left front, the right front, or both sides. The camera is linked via wired or wireless connection to an onboard computer and a navigation display that is located within the passenger compartment of the vehicle. The driver reviews a visual description on the display of any oncoming traffic in the form of motor vehicles, pedestrians, cyclists, animals and the like on the navigation display via a single screen, split screen or alternating screens. The camera system can include a speed sensor that detects when the vehicle reaches a threshold speed to activate or de-activate the camera. Alternatively, the computer can activate the system when a turn signal is activated, and de-activate the system when the turn signal is no longer activated. This camera system can be retrofitted into older vehicles.

RELATED APPLICATION

This application is a continuation in part of U.S. patent applicationSer. No. 13/587,548, filed Aug. 16, 2012, which claims the benefit ofU.S. Provisional Application Ser. No. 61/592,505, filed January 30,2012, and this application claims the benefit of U.S. Provisional PatentApplication No. 61/860,573, filed Jul. 31, 2013, the entire disclosuresof all said applications being expressly incorporated by referenceherein.

FIELD

This invention relates to vehicle safety devices, and more particularlyto visual displays that enhance vehicle safety.

BACKGROUND

Each year, thousands of people die or are badly injured in automobileaccidents. One situation that causes needless accidental deaths andinjury arises when a car moves into a street or motorway from a positionthat is perpendicular to the axis of that street or motorway. This canoccur when a vehicle is moving out of a street, parking garage orparking space. Drivers pulling into oncoming traffic from such aposition must begin by placing the front end of their vehicle far enoughout into the street that they can now directly view the oncomingtraffic. Cars parked along the side of the street can impair that visual“read” of the traffic, forcing the driver to protrude ever farther intothe oncoming traffic, at increasing risk to life, limb and vehicle topedestrians, cyclist, animals and other motorists.

The present state of the art for vehicle safety includes the use ofcameras mounted on the rear of vehicles to reduce collisions occurringas a result of a vehicle backing up. These systems utilize a small,pre-positioned stationary camera on the rear exterior of the vehicle anda visual display within the driver's compartment. This can beaccompanied by alarm devices that utilize modern proximity alert devices(for example, infrared technology) to detect an unseen obstacle (such asa child or a housecat) and call the driver's attention to the displayand the obstacle.

SUMMARY

The above described systems have a limited field of view and are easilydamaged or knocked off the vehicle. Likewise, they often require adedicated display that adds further distraction to the driver. Inaddition, such cameras often remain activated longer than needed.Moreover, such cameras are not mounted to contemplate particularhazardous situations, such as the pull out into traffic to execute aturn or a traffic merge.

Some embodiments described herein overcome disadvantages of the priorart by providing in a vehicle, a non-protruding front side vehiclecamera system and method for operating the same. In some embodiments,the non-protruding front side vehicle camera is flush mounted. In otherembodiments, the non-protruding front side vehicle camera is recessedbehind a surface of one or both front quarter panels. In someembodiments, the non-protruding front side vehicle camera is on the leftfront quarter panel. In some embodiments, the non-protruding front sidevehicle camera is on the right front quarter panel. In some embodiments,respective non-protruding front vehicle cameras are on each frontquarter panel.

The camera is linked to an onboard computer and a navigation displaythat is placed within the passenger compartment of the automobile. Thedriver receives a visual description on the display of any oncomingtraffic in the form of motor vehicles, pedestrians, cyclists, animalsand the like. In some embodiments, the camera system is furnished with aspeed sensor that detects when the automobile reaches a threshold speed(for example, 3 miles per hour). In other embodiments, a differentthreshold speed is selected and used. The front side vehicle camerasystem is activated and de-activated automatically, based on theselected threshold speed. In some embodiments, the camera systemactivation and de-activation process begins when the vehicle thatincludes the camera is shifted into the “Drive” gear (for a car equippedwith an automatic transmission), or first gear (for a car with astandard or semi-automatic transmission). The video signal istransmitted to the navigation display and displayed thereon in place ofthe ordinary navigation screen, in single or split screen. As soon asthe driver accelerates to the threshold speed, a signal is sent to thecomputer to shut off the camera, or to return the camera to thenavigation route (if any) being displayed prior to activation of theturn sequence. The computer now shuts down the camera and instructs thenavigation display to return its screen display to the ordinarynavigation display.

This system advantageously improves safety for vehicles moving into aline of traffic (turn) from a position that is perpendicular to the flowof that traffic and that are pulling out of a side street, building,garage or parking spot (merge). Often, such vehicles face hazards inperforming these maneuvers because the driver must pull far enoughforward to visually observe the near lane of traffic from his or hervantage point—which is typically several feet behind the front end ofthe vehicle. Illustratively, a protrusion of 4-6 feet or more isdesirable in order for the driver to view the lane and determine whetherto proceed or wait. During the movement to the protruded position, thefront end of the car is vulnerable to being struck by other vehiclesthat are unseen to the driver, resulting in numerous accidents. Theillustrative system and method provides a flush-mount or recessed cameraat the specific location on the vehicle to minimize this hazard bytransmitting an image of the scene of oncoming traffic to the driverfrom a vantage point that is essentially as far forward as possible.

Illustratively, in some embodiments, the camera is located in and isflush with the left front quarter panel. The front quarter panel is theouter portion of the vehicle forward of the passenger compartment alongthe left and right sides and typically includes a marker light andheadlight assembly. The camera is generally free of any externalprotrusion relative to the vehicle body and/or its quarter panel,thereby avoiding potential damage to the camera and/or a restrictedfield of view. In some embodiments, the flush-mounted or recessed cameracan image a field of view within an arc of approximately 90 degrees inboth the horizontal and vertical axes (thereby defining a viewing cone).Other embodiments provide different cross sectional geometries—e.g. ageometry defining an elliptical cone with a wider horizontal axis. Invarious embodiments, an associated camera lens can define a field ofgreater or lesser than 90 degrees in the horizontal and/or verticalaxes. In other embodiments, the system can allow the driver to selectthe desired angle and/or range of view via an interface or otheradjustment mechanism within the vehicle. The camera can also include apreset or variable zoom lens, thereby allowing the driver to focus overa greater or lesser distance.

This display can also be accompanied by a proximity alert. Inalternative embodiments, the visual display can use a heads-up projecteddisplay system, the onboard computer display, a separate and dedicateddisplay or a link to a head-mounted glasses display worn by the driver.In other embodiments, a plurality of two (or more) cameras are mountedin each respective one of the front quarter panels, one on the left sideas described above, and one on the right side, for vehicles entering aone-way street with traffic travelling from right to left relative tothe driver or vehicles that may be transported between the UnitedKingdom and Europe, and back, or vice-versa. In other embodiments, sucha camera system as set forth above can be fitted onto trucks of allsizes, recreational vehicles, tractors, heavy equipment, cycles andmotorcycles, quadricycles, military vehicles (such as tanks and otherarmored vehicles with limited visibility and massive height), or othervehicles.

In an illustrative embodiment, a system and method for providingfront-oriented visual information to a vehicle driver includes aflush-mounted or recessed camera located at least in the left frontquarterpanel. Alternatively, or additionally, a flush-mounted orrecessed camera can be mounted on the right front quarterpanel. A speedsensor detects vehicle speed. This speed sensor can be based upon anexisting vehicle system, such as the braking system and/or thespeedometer or can be a separate sensor. A display (e.g. a screen orprojection) within the vehicle provides the driver with at least one ofimages and video feed of a scene imaged by the camera. An onboardcomputer (or other processing device) processes the detected vehiclespeed and selectively allows the images and video feed to be displayedon the display based upon whether the vehicle speed is less than athreshold speed. In general, the computer instructs the camera systemand/or certain connected components to activate and deactivate dependingon the relative vehicle speed. Illustratively, the display can comprisean onboard navigation screen. The camera can image a field of view ofapproximately 90 degrees in at least one of a horizontal plane and avertical plane. Where two cameras are employed (i.e. on each of the leftfront and right front quarter panels), the display of images and/orvideo from one camera and the display images and/or video from the othercamera is performed using a split screen image.

The camera can also include a user-controllable zoom lens that allowsthe driver to vary the field of view and/or magnification. Either orboth cameras can include a co-mounted proximity sensor. The proximitysensor can be constructed and arranged to detect a nearby object, andcause a visual alert message to be displayed on the display and/or anaudible alert to be played via a speaker. Illustratively, the thresholdspeed can be approximately 3 miles per hour as such speed is consideredsufficiently low that the driver can react appropriately whileinteracting with the display screen. This threshold can beuser-adjustable via an interface within the vehicle in variousembodiments. More generally some or all of the functions of the systemcan be operated using voice activation.

The camera system can be provided with a proximity and speed sensor thatdetermines the range of an oncoming object and transmits the data to thecomputer. The computer provides an alert when the object is at least oneof (a) within a predetermined distance and (b) approaching at apredetermined speed. In some embodiments the camera can be retrofittedinto an existing front headlight pod and includes a wireless link tocommunicate with at least one of the display and computer. The systemcan include a solar power assembly that powers the camera and wireless.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention description below refers to the accompanying drawings, ofwhich:

FIG. 1 is a schematic view of an exemplary front end camera systemmounted in a vehicle, according to an illustrative embodiment;

FIG. 2 is a schematic view of the activation and de-activation of thecamera system, according to an illustrative embodiment;

FIG. 3 is a view of two exemplary automobiles of different shapes havingan exemplary left front camera, according to an illustrative embodiment;

FIG. 4 is a schematic view of a plurality of fields of view forexemplary front-end cameras situated in a vehicle according to anillustrative embodiment;

FIG. 5 is an overhead view of an intersection with oncoming trafficwherein one of the vehicles employs a camera system, according to anillustrative embodiment;

FIG. 6 is a schematic view of the activation of the camera systemfollowing selection using proximity sensors to determine the directionof traffic, according to an illustrative embodiment;

FIG. 7 is a schematic view of the activation of the camera systemfollowing selection using proximity sensors to determine the density oftraffic, according to an illustrative embodiment.

FIG. 8 is a view of an exemplary single screen display of oncomingtraffic in a single lane, according to an illustrative embodiment;

FIG. 9 is a view of an exemplary split screen display of oncomingtraffic in opposite lanes, according to an illustrative embodiment; and

FIG. 10 is a frontal view of an exemplary front headlight housing with afront end camera retrofitted into the housing, according to anillustrative embodiment.

FIG. 11 is a block diagram of an embodiment of the system activated byturn signals.

FIGS. 12A and 12B show flush mounted and recessed cameras, respectively.

FIG. 13 is a flow chart of a method of activating the system in singlevideo display mode according to some embodiments.

FIG. 14 is a flow chart of a method of activating the system in splitscreen display mode according to some embodiments.

FIG. 15 is a schematic diagram showing an embodiment having rear quarterpanel cameras.

FIG. 16 is a block diagram of an embodiment of quarter panel camerasystem using wireless communications.

DETAILED DESCRIPTION

When a motor vehicle driver is situated so as to be perpendicular to theflow of traffic and pulling out of a side street, building, garage orparking spot, there is a danger to that driver and other operators. Inorder to see traffic in the oncoming lane, the driver has to pull farenough forward to visually observe the near lane of traffic. Othervehicles and objects placed along a roadway and other obstructions canprevent a clear view and necessitate a driver pulling forward into thenear lane. Given that most vehicles have a front end that includes amotor or a storage compartment with a length of about 2-4 feet and thata driver typically sits another 2 feet or more from the dashboard, thedriver may move the car until there is a protrusion of 4-6 feet or more,in order for the driver to view the lane and determine whether toproceed or wait. During the movement to the protruded position, thefront end of the car is vulnerable to being struck by other vehiclesthat are unseen to the driver. This results in numerous accidents. Theinstallation of the front side vehicle system reduces the protrusion ofthe vehicle to about six inches. In the present application, the term“front left” refers to an American-style roadway in which the oncomingtraffic approaches from the left relative to the driver when enteringthe nearest lane on a two-way street. In other embodiments configuredfor an English-style system, the oncoming traffic approaches from theright relative to the driver, so the camera will be mounted on the frontright of the vehicle.

FIG. 1 is a schematic view of an exemplary front left vehicle camerasystem 100. The camera 102 is installed in the front left quarter panelregion of the vehicle (not shown). An optional front right camera 103will be described more fully below. Camera 102 is linked via wired orwireless connection to an onboard computer 104 with a control process105 and a commercially available navigation display 106 that is placedwithin the passenger compartment of the vehicle. The driver receives avisual description on the display 106 of any oncoming traffic in theform of motor vehicles, pedestrians, cyclists, animals and the like. Thecamera system 100 can be powered by a 12 Volt power supply or otherapplicable power supply having a higher or lower voltage and current.The camera system equipped with a speed sensor 108 that detects when thevehicle 100 reaches a threshold speed, in this embodiment, of 3 milesper hour. The speed sensor 108 receives input from the vehicletransmission (not shown) and the computer 104. The speed sensor 108transmits the information for the threshold speed to the display 106and/or computer 104. In some embodiments, the wiring harness usesconventional connectors and existing “off the shelf” technology. Inother embodiments, a future developed connector and/or powertransmission medium is used. The computer 104 can be provided with atransmitter/receiver for wireless communication with wireless sensorsand cameras.

The 3 miles per hour threshold speed is determined in part by thetransmission after the vehicle is put into the “Drive” gear setting 110and is communicated both to the speed sensor 108 and the computer 104simultaneously via wired or wireless communication. It is contemplatedthat the threshold speed can be set by the driver to a higher or lowerspeed, or to a range, depending on the driver's requirements. Forexample, a driver can require a range of 2-4 miles per hour, 3-5 milesper hour or 5-10 miles per hour, depending on the desired start-upvelocity. In a situation where the traffic is moving quickly, a higherrange can be desired. The threshold speed sensor can interface with anynumber of the systems within the vehicle that measure speed. Theseinclude the speedometer, anti-lock braking system, the door lock system,engine rpm, GPS (ground positioning satellite) or combination thereof Ina further embodiment, the activation and de-activation can bevoice-activated by the driver. It is further contemplated that thiscamera system can be retrofitted into older vehicles.

The computer 104 can include an optional voice activation process 107that is accessed via a microphone 109. The computer 120 can also beprovided with a memory application 120 that records events and pulloutsfor records or later analysis. Activating the various settings forthreshold speed and other settings can be accomplished via the displayscreen, a touch screen interface, a remote control or other device. In afurther embodiment, the vehicle can be equipped with a level detectiondevice 134 that determines the attitude of the vehicle relative to thehorizon. The vehicle camera(s) can be equipped with one or more servomotors (or another type of actuator, such as a stepper motor) to orientat least one of the cameras, as will be described more fully below. Thecomputer 104 can be provided with a process for receiving theinformation from the level detection device 134 that determines theoptimal attitude for the cameras and a camera attitude control process132 instructs the camera servo motors to make the proper adjustments.This attitude adjustment control can be manually operated 136 by theuser.

In a further embodiment, the computer 104 is configured by software toexecute a process for receiving and acting upon data from proximitysensors, as described more fully below. The proximity sensors transmitdata to the computer 104 that includes the detected proximity and speedof the nearest vehicle 140 in the traffic lane and processes thatinformation 142 for display. In an additional embodiment, the vehiclehas a proximity alert, as set forth more fully below, that is activatedby the proximity speed process 142 and generates an alert 144.

The front side vehicle camera system is activated and de-activatedautomatically as set forth in FIG. 2. Note, as used herein the terms“activated” and “de-activated” can relate to at least one of theactivation/de-activation of the actual camera, theactivation/de-activation of the display and/or theactivation/deactivation of the communication/data link(s) between thecamera, computer and display. The camera system activation andde-activation process 200 begins when the vehicle that includes thecamera is shifted into the “Drive” gear (for a vehicle having anautomatic transmission) or first gear (for a vehicle having a standardor semi-automatic transmission) at step 202. At step 204, thetransmission instructs the computer that the vehicle is in the “Drive”gear or first gear, and the vehicle's computer turns on the camera and,at step 206, the computer starts the video camera function. At step 208,the video signal is transmitted to the navigation display and displayedthereon in place of the ordinary navigation screen. As soon as thedriver pulls out and accelerates to the threshold speed at step 210, asignal is sent to the speed sensor and at step 212, the speed sensorinstructs the computer that the vehicle is traveling at the thresholdspeed of 3 miles per hour and to shut off the camera. The computer nowshuts down the camera and, at step 214, instructs the navigation displayto return its screen display to the ordinary navigation display.

FIG. 3 is a view of two illustrative automobiles of different shapeshaving an illustrative left front camera. Vehicle 300 is a sports cartype vehicle with two seats and a reclined driver position. The distanceD between the reclined driver position 302 and the camera location 304(about six inches to the rear of the forward left leading edge of thevehicle) is about 6 feet. In some embodiments, the camera 306 is locatedin and flush with the left front quarter panel 308, providing the driverwith a full visual display of oncoming objects. In other embodiments,the camera 306 is slightly recessed behind the surface of the frontquarter panel 308, while still maintaining a desired field of view. Thecamera 306 is not externally mounted and does not protrude from thequarter panel. Externally mounted cameras tend to produce blind spotsthat a flush-mounted camera does not produce. Externally mounted camerasare physically more vulnerable to being inadvertently damaged due tobushes, obstacles, stones and other physical risks. The camera 322mounted in the left front quarter panel 324 of the sedan-type vehicle320 is also flush-mounted. Cameras 306, 322 can be provided with a fieldof view that describes an arc of about 90 degrees in the horizontal andabout 90 degrees in the vertical axes according to the illustrativeembodiment. The cameras can be auto-focused or selectively focused bythe user. In some embodiments, a camera lens with a field of viewgreater or lesser than 90 degrees in the horizontal and vertical axescan be utilized. In other embodiments, a lens giving a field of view asgreat as 150 degrees is used. The camera lens can be provided with azoom lens that is automatically operated by the computer 104 and/or theuser. In other embodiments, the camera is a digital camera equipped witha digital zoom to permit the user to view an enlarged cropped view of asubset of the pixels of the camera 306. As noted above, the camera canbe furnished with an integral proximity sensor and the computer can beactivated thereby to provide a proximity alert, either by an audioalert, visual alert or a combination thereof. In some embodiments, theproximity sensor is a commercially available sensor and the typesavailable for this application can include capacitive, capacitivedisplacement sensors, Doppler effect (sensor based on effect),eddy-current, inductive, laser rangefinder, infrared, sonic, ultrasonic,LIDAR, stereoscopic, magnetic, passive optical, passive thermalinfrared, reflective photocell, radar, ionizing radiation reflector orthermal sensors. The proximity speed process can process a continuousstream of information from the proximity sensor(s) or a series offrame-by-frame images. In general, the proximity speed process 142 usesknown technologies to derive distance and compare distance to time so asto provide a continuous velocity reading for the object.

As stated above, the camera projects an image of the roadway within thefield of view and assists the driver in looking for oncoming traffic.This is projected as a single screen or, in the case of cameras mountedon each front corner, as a split screen or alternating. For example, thedisplay can automatically and periodically alternate between displayingthe left side view in full screen mode and the right side view in fullscreen mode. For added safety, such full screen display can includeindicia (such as a large arrow pointing to the direction—left orright—of the sensor from which the video feed is currently beingdisplayed) In various embodiments, the displayed video allows the driverto see in one or both directions, or selectively view one or the other.The camera can be provided with a preset or variable zoom lens, allowingthe driver to focus over a greater or lesser distance.

FIG. 4 is a schematic view of the field of view for front-end cameras402 mounted on an exemplary vehicle 400. The lateral axis LA isperpendicular 404 to the vehicle center axis VCA and passes through thecenter points of the front-end cameras 402 according to an illustrativeembodiment. The lateral axis LA is defined as an axis projectedperpendicular to the vehicle centerline axis, which is the centerline ofthe vehicle and projects from front to rear. The field of view of eachcamera 402 is depicted in this embodiment as describing 90 degrees. Thecamera field of view is adjustable up to approximately 30 degreesforward AF of the lateral axis LA and up to approximately 10 degreesrearward AR of the lateral axis. In various embodiments, the angularadjustments forward and rearward are greater or lesser as desired. Theoptical axis 410 (shown in dashed line) of cameras oriented on thelateral axis LA and having a field of view of 90 degrees will beprovided with a forward limit 412 (shown in dashed line) of 45 degreesforward of the lateral axis LA and a rearward limit 414 (shown in dashedline) of 45 degrees rearward of the lateral axis LA. When a camera isadvanced so that its optical axis 420 (shown in dotted lines) isoriented 30 degrees forward of the lateral axis LA, its forward limit422 (shown in dotted lines) is 80 degrees forward of the lateral axis LAand its rearward limit 424 (shown in dotted lines) is 15 degreesrearward of the lateral axis LA. When the camera is oriented so that itsoptical axis 430 (shown in dashed and double dotted line) is 10 degreesrearward of the lateral axis LA its forward limit 432 (shown in dashedand double dotted line) is 35 degrees forward of the lateral axis LA andits rearward limit (shown in dashed and double dotted line) is 55degrees rearward of the lateral axis LA. In further embodiments, inwhich the field of view is greater or lesser than 90 degrees and therange of camera orientation if greater or lesser, these field of viewlimits will vary. Note, as used herein, directional and orientationalterms such as “top”, “bottom”, “front”, “rear”, “up”, “down”, “forward”,“rearward”, “horizontal”, “vertical”, “right”, “left”, “above” and“below” as well as their synonyms, are meant to be relative only and notabsolute with respect to the acting direction of gravity.

The optical axis can be adjusted on the vertical axis. In an embodiment,the optical axis can be raised approximately 30 degrees and loweredapproximately 10 degrees relative to the horizon. This verticaladjustment can be useful when approaching a hillside road from an entrythat is relatively level. Adjustment of the camera elevation cancompensate for the slope of the traffic lane and avoid potential blindspots.

FIG. 5 is a top plan view of an exemplary intersection and depicts avehicle 500 that is furnished with an installed front left camera system502. In this embodiment, the vehicle 500 is situated at point PI on anintersecting street 504 and is preparing to enter a street 506 that isperpendicular to the intersecting street 504. The driver of the vehicle500 has an obstructed view of the near lane 508, because of a line ofparked cars 510. There is an oncoming car 512. In an embodiment, thedistance D1 between vehicles is about 100 feet and reducing based on therate of travel of vehicle 512. The driver of vehicle 500 moves forwardsix inches to point P2 and uses the camera system. The front left sidecamera 414 provides a view across a 90 degree field of view thatincludes an obstructing building 516. The driver inches forward until aview of the lane 508 beyond the obstructing building 516 and line ofcars 510 can be obtained. The optical axis of the camera field of view520 is oriented approximately 25 degrees forward of the vehicle lateralaxis LA and the field of view is set at 90 degrees. FIG. 5 shows theforward limit 522 of the camera field of view. The driver visuallychecks the projected camera view on the navigational display (not shown)and notices approaching vehicle 512. At this point, the driver cannotyet visually see vehicle 512 without the front left camera 514. As setforth above, this display can be accompanied by a proximity alert. Thedriver of vehicle 500 is now aware of vehicle 512 and decides to refrainfrom moving into lane 508 until vehicle 512 has passed. In a traditionalvehicle not having the camera system, the driver of vehicle 500 wasrequired to advance to point P3, well into the path of vehicle 512,before being able to personally view the oncoming traffic.

The use of proximity sensors to automatically select one or the othercamera for display is shown in FIGS. 6 and 7. Referring now to FIG. 6, avehicle is equipped with two front end cameras, a respective cameramounted to each of the front end quarter panels. Each camera is equippedwith a proximity sensor. The automatic process 600 begins when thevehicle arrives at the intersection 602 and the driver moves forward tocause the front end of the vehicle to protrude 4-6 inches into traffic604. The proximity sensors begin scanning either direction and the datagathered from each is relayed to the computer 606. The computerprocessor evaluates the data and determines the direction of traffic inthe near lane. When that process is complete, the computer determineswhich camera is preferred 608 and the feed from that camera is shown onthe display 610.

For example, in some embodiments, if both proximity sensors detectmoving vehicles in their respective fields of view, the computer selectsthe camera on the same side of the car as the proximity sensor whichsenses the closer of the moving vehicles. In other embodiments, theproximity sensors provide location and speed data for vehicles in theirfield of view; the computer estimates an amount of time before thedetected cars on each side reach the intersection, and selects thecamera on the same side of the car as the proximity sensor which sensesthe moving vehicle which is expected to reach the intersection first.For example, in some embodiments, the computer calculates the time asthe ratio of (distance from intersection/speed) In some embodiments, thecomputer compares the estimated length of time till arrival for thedetected cars on each side to a threshold length of time within whichthe driver can safely enter the desired traffic lane. If the estimatedtime till arrival is less than the threshold, an alert is provided. Insome embodiments, an audio or video alert notifies the driver from whichside a detected moving vehicle is expected to arrive in the intersectionfirst.

In the event that there is no traffic present, the camera display willrevert to a default setting, for example, to a split screen display.

In other embodiments, as further shown in FIG. 7, a process toautomatically select the camera to be displayed uses proximity sensorsto determine traffic density 700. The begins when the vehicle arrives atthe intersection 702 and the driver moves forward to cause the front endof the vehicle to protrude 4-6 inches into traffic 704. The proximitysensors begin scanning either direction to read traffic density in bothdirections and the data gathered from each is relayed to the computer706. The computer processor evaluates the data and determines thedensity of traffic in the near lane. When that process is complete, thecomputer determines which camera is preferred 708 and the feed from thatcamera is shown on the display 710. In the event that there is notraffic present, the camera display will revert to a default setting,for example, to a split screen display.

The displayed view from the cameras can be displayed on the navigationaldevice display, as set forth above. FIGS. 8 and 9 show the view asprojected on the display using single and split screen views. FIG. 8shows the view 800 from a left front-end camera with attached proximitysensor. The user has protruded the vehicle into the traffic lane farenough past a parked vehicle 802 for the camera to see the oncomingtraffic 804. The proximity sensor detects oncoming vehicle 806 anddetects that the vehicle is about 50 feet away and closing on the user.The proximity sensor transmits this data to the computer (not shown) andthe computer presents the proximity sensor information 808 as part ofthe display. In an illustrative embodiment, the information provided isthat a vehicle is approaching 810 at a rate of 15 miles per hour 812 andis at a distance of 50 feet from the camera. In some embodiments, theinformation can be provided using the metric system and with otherinformation. This information is also sent through the proximity sensoralert process (144 in FIG. 1, above) and meets the alert processcriteria for generating an alert 812 that is included on the display. Insome embodiments, this alert can be flashing, accompanied by soundsand/or other stimulating sounds and lights to get the user's attentionand discourage the user from entering the lane and creating a potentialcrash. Alternatively, or additionally, the alert cause the entire screento assume a particular tint (e.g., red) to attract the user's attention.

FIG. 9 is a view of a split screen display 900 with the left view 902showing the display view of FIG. 8 above. The right screen 904 shows aview of the street opposite from the view of the left screen 902 and isthe view of the right front-end camera with an attached proximitysensor. There is a parked car 904 along the curb and the near lane 906is clear of obstacles to the right. The farther lane 908 is mostlyclear, with one approaching vehicle 910 at a distance. The proximitysensor notes the approaching vehicle 910 and transmits this data to thecomputer (not shown) and the computer presents the proximity sensorinformation 912 as part of the display. The computer uses one or morealgorithms to determine speed, distance, high speed, and/or estimatedtime of arrival of the detected vehicles in the intersection, and toevaluate if an alert should be issued to the user when a predeterminedcriteria/threshold has been met. In an illustrative embodiment, theinformation provided is that a vehicle is approaching 910 at a rate of15 miles per hour 812 and is at a distance of 200 feet from the camera.This information is also transmitted to the proximity sensor alertprocess (as set forth above) but it does not meet the criteria and noalert is provided.

The front-end camera system can be provided as part of a kit and can beretrofitted into existing vehicle headlight pod assemblies. FIG. 10shows the left side of the front end of a vehicle 1000 having aheadlight housing 1002. The user has caused a mounting hole 1004 to becut into the inner wall 1006 of the housing 1002. The camera assembly1008 with the proximity sensor 1010 is situated a distance DA ofapproximately six inches from the front end of the car 1012. The camerasystem and proximity system do not interfere with the functionality ofthe headlight 1014. The installed camera and sensor assembly can bepowered directly from the vehicle wiring harness or by another powersource (for example, solar). In some embodiments, the solar cell islocated in a transparent part of the pod or externally mounted in aholder on the exterior of the front quarter panel. The camera andproximity data can be transmitted by wired communication or by wirelesscommunication. In other embodiments, the camera and sensor assembly caninclude a local control circuit for guided or automatic control.

In some embodiments, the front-end camera system can be provided with abuilt-in sensor that detects the speed and distance of an oncomingvehicle. This can be added to a system having a camera and a proximitysensor or to a system that is a camera on its own. In the latter case,the data from the detected range and speed of the oncoming traffic canbe used to trigger a proximity sensor, based on pre-set parameters.Vehicular front-end cameras equipped with laser rangefinders usecommercially available devices, including laser, radar parallax, and/orother technologies.

The system described above enhances the safety of the driver underordinary traffic conditions and in more challenging situations. Thesystem desirably avoids undue distraction and can be applied readily tore-manufacture or retrofit applications.

Further, the system can employ conventional, commercially availablecomponents, and/or customized components. Also, as used herein the terms“process” and/or “processor” should be taken broadly to include avariety of electronic hardware and/or software based functions andcomponents. Moreover, a depicted process or processor described hereincan be combined with other processes and/or processors described hereinor divided into various sub-processes or processors. Such processes,processors, sub-processes and/or sub-processors can be combinedaccording to various embodiments, and all such combinations are includedherein as part of this disclosure. Likewise, it is expresslycontemplated that any function, process and/or processor here herein canbe implemented using electronic hardware, a non-transitorycomputer-readable storage medium encoded with software programinstructions, or a combination of hardware and software.

The camera system as set forth above can include a solar-based powersupply that includes a solar power collector and a power storagebattery, enabling the system to be fully or partially powered by solarpower.

The camera system described above can be equipped with cameras thatoperate both in daylight conditions and at night. It is expresslycontemplated that the system can be provided with a night-timeapplication that utilizes existing night vision technology (for example,infrared, passive, photomultiplier devices or other night vision systemthat acquires information in various wavelengths). This can be utilizedto detect non-lighted objects in the motor way, including but notlimited to trashcans, pedestrians, animals, wrecked vehicles and otherhazards.

In some embodiments, the front quarter panel camera system activation istriggered by activation of the left turn signal 152 or right turn signal151. FIG. 11 is a block diagram of an example according to someembodiments. In FIG. 11, a system 1100 for providing visual informationto a driver of a vehicle comprises at least one flush-mounted orrecessed camera located at least in a front quarter panel of thevehicle. In the example of FIG. 11, both a left front quarter panelcamera 102 and a right front quarter panel camera 103 are provided. Thecameras 102, 103 image a field of view of approximately 90 degrees in atleast one of a horizontal plane and a vertical plane. In someembodiments, as shown in FIG. 12A, the camera 102 is mounted flush withthe surface of the left or right quarter panel 324. In otherembodiments, as shown in FIG. 12B, the camera 103 is recessed slightlybeneath the surface of the quarter panels. In some embodiments, as shownin FIG. 12B, a center 153 of the field of view of each camera is offsetby an angle 154 from 0 degrees to about 17 degrees forward of a surfacenormal N of a side of the vehicle (left or right quarter panel). In someembodiments, the angle 154 is from about 5 degrees to about 15 degrees.By orienting the cameras 102, 103 at a small angle, the forward travelof the vehicle into the intersection to view a given object on videousing the front quarter panel cameras 102, 103 can be reduced in someembodiments.

The vehicle includes a display 106 within the vehicle that provides thedriver with at least one of images or video feed of a scene imaged bythe camera. In some embodiments, the display 106 is the screen of anonboard navigation system. In other embodiments, the display is thedisplay of a mobile device, such as a tablet or smart phone. In someembodiments, the mobile device interfaces to the camera via a personalarea network (PAN) 155, such as a Bluetooth interface in the vehicle,which is connected to the CAN bus 150 (or other vehicle bus).

An onboard computer 104 detects whether a turn signal 102 or 103 of thevehicle is activated and selectively causes the images or video feed tobe displayed on the display 106 when the turn signal 102 or 103 of thevehicle is activated. In some embodiments, the control signals whichdrive the turn signals are passed to the computer 104 via a controllerarea network (CAN) bus 150 or using another on board diagnostic (OBD-II)protocol.

In some embodiments, the onboard computer 104 is configured to cause thedisplay 106 to display at least one of images or video from the firstcamera 102 and at least one of images or video from the second camera103 on a split screen image, in the manner shown in FIG. 9.

In some embodiments, the onboard computer causes the displaying of theimages or video feed to continue as long as the turn signal 151, 152 ofthe vehicle is still activated. The onboard computer causes thedisplaying of the images or video feed to stop when the computerdetermines that the turn signal of the vehicle is no longer activated.

FIG. 13 is a flow chart of a method of operating the system 1100 of FIG.11 for a single image or video feed.

At step 1302, the computer 104 determines whether the left turn signal152 is on. If the left turn signal 152 is on, step 1304 is performed.Otherwise, step 1310 is performed.

At step 1304, the computer 104 causes the image or video feed from theleft camera 102 to be displayed on the display 106.

At step 1306, the computer 104 periodically checks whether the left turnsignal is still turned on. If the left turn signal is still on, theimage or video feed is continued at step 1304. If the left turn signalis no longer on, step 1308 is performed.

At step 1308, the computer 104 causes the display 106 to return to itsprevious content. For example, if the display was showing a navigationroute prior to initiating the turn, the display 106 is returned to thecontrol of the navigation system.

At step 1310, the computer 104 determines whether the right turn signal151 is on. If the right turn signal 151 is on, step 1312 is performed.Otherwise, execution returns to the beginning of the loop at step 1300.

At step 1312, the computer 104 causes the image or video feed from theright camera 103 to be displayed on the display 106.

At step 1314, the computer 104 periodically checks whether the rightturn signal is still turned on. If the right turn signal is still on,the image or video feed is continued at step 1312. If the right turnsignal is no longer on, step 1316 is performed.

At step 1316, the computer 104 causes the display 106 to return to itsprevious content.

FIG. 14 is a flow chart of an embodiment for split screen viewing ofimage or video feed from both left and right front quarter panels 102,103.

At step 1402, the computer 104 determines whether either the left orright turn signal 151, 152 is turned on. If either is turned on, step1406 is performed. If neither turn signal 151, 152 is turned on, step1404 is performed.

At step 1404, the computer waits for a predetermined period and returnsto the beginning of the loop at step 1400.

At step 1406, the computer 104 causes power to be supplied to thecameras 102, 103.

At step 1408, each of the cameras 102, 103 performs auto focus andbrightness/motion detection.

At step 1410, the computer 104 receives the image or video feeds fromboth cameras 102, 103 and merges the two feeds to form a split screen(e.g., as shown in FIG. 9).

At step 1412, the computer 104 determines whether the turn signal 151 or152 is still active. If the turn signal 151, 152 is still active, step1418 is performed. If neither turn signal is active, step 1414 isperformed.

At step 1414, the computer 104 waits for a predetermined period (e.g., 5seconds) after the turn signal 151, 152 is turned off.

At step 1416, the computer 104 causes deactivation of camera powersupplied to cameras 102, 103. The computer returns the program counterto perform step 1400, and the image/video display system goes to standbymode.

At step 1418, the split screen images or video is displayed on thedisplay device 106.

Although the above-described embodiments include front quarter panelmounted cameras 102, 103, in other embodiments, the system includes atleast one camera 1505, 1506. The camera(s) 1505, 1506 can be flushmounted or recessed relative to the surface on the left rear quarterpanel 1507 and/or right rear quarter panel 1508. The cameras 1505, 1506are configured to image a field of view 1520, 1525, respectively, withinan arc of approximately 90 degrees in both the horizontal and verticalaxes. In other embodiments, the field is greater or lesser than 90degrees in the horizontal and/or vertical axes. In some embodiments, theleft and/or right rear quarter panel cameras 1505, 1506 are positionedwithin about six inches (15 cm) of the rear end of the quarter panel(s)1507, 1508, respectively.

The rear quarter panel mounted camera(s) 1505, 1506 provide video oftraffic coming from one or both directions when the vehicle 1500 isbacked out (e.g., from a driveway) into a street 506. In someembodiments, both left and right rear quarter panel cameras 1505, 1506provide images or video to be displayed by a passenger compartmentdisplay 106, such as the navigation system display.

In some embodiments, the left and/or right rear quarter panel camerasare activated when the driver places the transmission 1502 into reversegear (indicated by “R” in FIG. 15), and deactivated when thetransmission 1502 is no longer in reverse gear.

In other embodiments, either the right or left rear quarter panel camera1505, 1506 is activated when the driver places the transmission 1502into reverse gear, and the right turn signal 1511 or left turn signal1512, respectively, is activated. When the transmission 1502 is nolonger in reverse gear, or the turn signals 1511, 1512 are bothdeactivated, the video feed from the right or left quarter panel camera1505, 1506 is deactivated.

In some embodiments, the car is equipped with both a rear facing camera1530 and right and left rear quarter panel cameras 1505, 1506,respectively. Either the right or left rear quarter panel camera 1505 or1506 (or both) is (are) activated when the driver places thetransmission 1502 into reverse gear, and the right or left turn signal1511, 1512, respectively, is activated. If the transmission 1502 is inreverse gear, but neither right nor left turn signal 1505, 1506 isactivated, the video feed from the rear facing camera 1530 is displayed.When the transmission 1502 is no longer in reverse gear, the displayreturns to the navigation display.

In some embodiments, the vehicle is equipped with front left quarterpanel camera 102, front right quarter panel camera 103, rear rightquarter panel camera 1505 and rear left quarter panel camera 1506. Oneor both of the front quarter panel cameras 102, 103 are activated whenthe transmission is in “Drive” (for an automatic transmission) or firstgear (for a standard or semiautomatic transmission), and the left turnsignal 152 or right turn signal 151 is activated. One or both of therear quarter panel cameras 1505, 1506 are activated when thetransmission is in reverse, and the left turn signal 152 or right turnsignal 151 is activated.

FIG. 16 is a block diagram of an embodiment of a system 1600 includingone or more wireless devices.

The system 1600 includes at least one wireless camera on one of thefront quarter panels. For example, a wireless camera 1602 transmitsimage or video data from the left front quarter panel, and a wirelesscamera 1603 transmits image or video data from the right front quarterpanel.

In some embodiments, the right and left wireless cameras 1602, 1603 areactivated by the in-gear sensor 110 or speed sensor 108 as describedabove, or by the computer 104 determining that the right or left turnsignal 151, 152 is activated. For example, in one embodiment, aproximity and speed sensor determines the range of an oncoming objectand the computer 104 (FIG. 1) provides an alert when the object is atleast one of (a) within a predetermined distance of the vehicle, (b)approaching at a speed greater than or equal to a predetermined speed,or (c) expected to reach a location of the vehicle in less than apredetermined length of time. In one embodiment, the computer 104calculates the expected length of time till the object reaches theintersection by dividing the distance (between the object and thevehicle) by the current speed of the object.

The image or video data are received by a corresponding wireless networkhub 1610. In some embodiments, the cameras 1602, 1603 communicate withhub 1610 by a wireless protocol, such as 802.11 (WiFi) or Bluetooth.

In some embodiments, the wireless network hub 1610 is connected to thecar equipment 1620, which can include: a navigation system 1621 coupledto a non-transitory machine readable storage medium 1622 encoded withnavigation data. The navigation system 1621 includes manual controls1623 for operating the navigation system and/or configuring the quarterpanel camera and display system 1600. In some embodiments, the manualcontrols 1623 permit the driver to select either full screen or splitscreen mode for display. A display 900 is provided to display thenavigation data when the quarter panel cameras are not active, anddisplay the image or video feed from the front quarter panel cameraswhen the cameras are activated.

In some embodiments, a mobile device 1630, such as a smart phone ortablet communicates with the hub 1610 by a wireless protocol, such as802.11 (WiFi) or Bluetooth. In some embodiments, the mobile device runsa mobile app which, when activated, waits for the image or video feedfrom the cameras 1602, 1603, and displays the video feed on the mobiledevice 1630. The activation of the image or video feed is controlledaccording to one of the methods described herein, such as based oncurrent transmission state, current vehicle speed, object proximity,and/or turn signal activation.

In other embodiments, the mobile app is configured to allow the user tomanually activate and deactivate the cameras 1602, 1603 using agraphical input screen on the mobile device, independently of thetransmission state, vehicle speed, object proximity, and turn signalactivation. Once the cameras are activated, the mobile device 1630continuously displays the image or video feed(s) from the left or rightcamera 1602 or 1603, or both, until the user manually deactivates thefeed(s) using the mobile device. In some embodiments, when the mobileapp manually activates the front quarter panel cameras, the displayingof the image/video feed from the cameras on the navigation systemdisplay is suspended until the mobile app is terminated. By using themobile device 1630 for displaying the image or video feeds from thecameras 1602, 1603, the user avoids any interruption of the normalnavigation system display. The driver may prefer to use this feature,for example when navigating a route with frequent closely spaced turns.

In some embodiments, the system is voice activated. For example, in anembodiment using a mobile device 1630, the mobile app for controllingthe front quarter panel cameras 1602, 1603 is responsive to voicecommands. A computer (not shown) within the mobile device 1630 causesthe display of image data from either the left or right front quarterpanel cameras in response to a voice command issued to the mobiledevice. In some embodiments, the computer within the mobile device 1630causes the display of image data from both the left and right frontquarter panel cameras in split screen mode in response to a voicecommand.

Although FIG. 16 is described above for an example in which the left andright cameras 1602, 1603 are on the front quarter panels, in otherembodiments, the cameras 1602, 1603 are flush mounted or recessed in theleft and right rear quarter panels, and all the remaining discussion ofFIG. 16 applies fully with substitution of rear quarter panel cameras.

In some embodiments, the visual display can use a heads-up projecteddisplay system, the onboard computer display, a separate and dedicateddisplay or a link to a head-mounted glasses display worn by the driver.In other embodiments, there can be two cameras mounted in each of thefront quarter panels, one of the left side as described above, and oneon the right side, for vehicles entering a one-way street with traffictravelling from right to left relative to the driver or vehicles thatmay be transported between the United Kingdom and Europe, and back, orvice-versa. It is further contemplated that GPS systems can be used todetermine the national driving customs based on location and toautomatically preset the cameras. The GPS location can also be used topreset based on information of traffic patterns based on location andthe latest available street traffic directions. It is contemplated thatsuch a camera system as set forth above can be fitted onto trucks of allsizes, recreational vehicles, tractors, heavy equipment, cycles andmotorcycles, quadricycles, military vehicles (such as tanks or otherarmored vehicles), or other vehicles.

The methods and system described herein may be at least partiallyembodied in the form of computer-implemented processes and apparatus forpracticing those processes. The disclosed methods may also be at leastpartially embodied in the form of tangible, non-transitory machinereadable storage media encoded with computer program code. The media mayinclude, for example, RAMs, ROMs, CD-ROMs, DVD-ROMs, BD-ROMs, hard diskdrives, flash memories, or any other non-transitory machine-readablestorage medium, wherein, when the computer program code is loaded intoand executed by a computer, the computer becomes an apparatus forpracticing the method. The methods may also be at least partiallyembodied in the form of a computer into which computer program code isloaded and/or executed, such that, the computer becomes a specialpurpose computer for practicing the methods. When implemented on ageneral-purpose processor, the computer program code segments configurethe processor to create specific logic circuits. The methods mayalternatively be at least partially embodied in a digital signalprocessor formed of application specific integrated circuits forperforming the methods.

The foregoing has been a detailed description of illustrativeembodiments of the invention. Various modifications and additions can bemade without departing from the spirit and scope of this invention.Features of each of the various embodiments described above can becombined with features of other described embodiments as appropriate inorder to provide a multiplicity of feature combinations in associatednew embodiments. Furthermore, while the foregoing describes a number ofseparate embodiments of the apparatus and method of the presentinvention, what has been described herein is merely illustrative of theapplication of the principles of the present invention. Accordingly,this description is meant to be taken only by way of example, and not tootherwise limit the scope of this invention.

1. A system for providing visual information to a driver of a vehicle,comprising: at least one flush-mounted or recessed camera located atleast in a front quarter panel of the vehicle; a display within thevehicle that provides the driver with at least one of images or videofeed of a scene imaged by the camera; and an onboard computer thatdetects whether a turn signal of the vehicle is activated andselectively causes the images or video feed to be displayed on thedisplay when the turn signal of the vehicle is activated.
 2. The systemas set forth in claim 1, wherein the display is an onboard navigationscreen.
 3. The system as set forth in claim 1, wherein the camera imagesa field of view of approximately 90 degrees in at least one of ahorizontal plane and a vertical plane.
 4. The system as set forth inclaim 1, wherein the at least one camera includes a first camera,flush-mounted or recessed in a right front quarter panel of the vehicleand a second camera, flush-mounted or recessed in a left front quarterpanel of the vehicle.
 5. The system as set forth in claim 3, wherein theonboard computer is configured to cause the display to display at leastone of images or video from the first camera and at least one of imagesor video from the second camera on a split screen image.
 6. The systemas set forth in claim 1, wherein the onboard computer causes thedisplaying of the images or video feed to continue while the turn signalof the vehicle is still activated.
 7. The system as set forth in claim1, wherein the onboard computer causes the displaying of the images orvideo feed to stop when the computer determines that the turn signal ofthe vehicle is no longer activated.
 8. The system as set forth in claim1, wherein the system is voice activated.
 9. The system as set forth inclaim 8, wherein the computer causes the display of image data fromeither the left or right front quarter panel cameras in response to avoice command.
 10. The system of claim 8, wherein the computer causesthe display of image data from both the left and right front quarterpanel cameras in split screen mode in response to a voice command. 11.The system of claim 1, further comprising a network interface totransmit the video data to a mobile device within the vehicle, to bedisplayed by the mobile device.
 12. The system of claim 1, furthercomprising a left rear quarter panel camera or right rear quarter panelcamera, the left or right rear quarter panel camera being flush mountedor recessed, and coupled to provide a video display feed, wherein thecomputer is configured to cause display of the video display feed of therear quarter panel camera when the transmission is in reverse gear. 13.The system of claim 1, further comprising a left rear quarter panelcamera or right rear quarter panel camera, the left or right rearquarter panel camera being flush mounted or recessed, and coupled toprovide a video display feed, wherein the computer is configured tocause display of the video display feed of the rear quarter panel camerawhen the transmission is in reverse gear and a turn signal is activated.14. The system of claim 13, wherein the computer is configured todiscontinue display of the video display feed of the rear quarter panelcamera when the turn signal is no longer activated.
 15. The system ofclaim 13, wherein the vehicle further comprises a rear facing camera,and the computer is configured to cause display of a video display feedof the rear facing camera when the transmission is in reverse gear andno turn signal is activated.
 16. The system as set forth in claim 1,further comprising a proximity and speed sensor that determines therange of an oncoming object and wherein the computer provides an alertwhen the object is at least one of (a) within a predetermined distanceof the vehicle, (b) approaching at a speed greater than or equal to apredetermined speed, or (c) expected to reach a location of the vehiclein less than a predetermined length of time.
 17. The system as set forthin claim 1 wherein the flush mounted camera is located in a frontheadlight pod and includes a wireless link to communicate with at leastone of the display and computer.
 18. A method for providing visualinformation to a driver of a vehicle comprising steps of: selectivelyactivating a flush-mounted or recessed camera on a front quarter panelof the vehicle when a turn signal of the vehicle is activated; andreceiving and displaying visual information from the camera of at leastone of images or video while the turn signal is activated.
 19. Themethod of claim 18, further comprising de-activating the camera anddiscontinuing display of the images or video when the turn signal is nolonger activated.
 20. A method for providing visual information to adriver of a vehicle comprising steps of: selectively activating aflush-mounted or recessed camera on a rear quarter panel of the vehiclewhen a transmission of the vehicle is in reverse gear and a turn signalof the vehicle is activated; receiving and displaying visual informationfrom the camera on the rear quarter panel of at least one of images andor video while the transmission of the vehicle is in reverse gear andturn signal is activated; and discontinuing the displaying of visualinformation from the camera on the rear quarter panel when either thetransmission of the vehicle is no longer in reverse gear or the turnsignal is no longer activated. 21-41. (canceled)